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SYSTEM AND METHOD FOR SWITCH TIMING SYNCHRONIZATION 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The invention relates generally to broadband switch 
architecture and, more particularly, to a system and method for 
synchronizing the timing between line cards and switch cards in a 
broadband switch. 

2. Description of the Related Art 

As noted in US Patent 6,188,687 (Mussman et al), networks 
transfer electronic information between different locations. Broadband 
networks may convey broadcast-like video distribution, individual access 
to video program hbraries, video telephone, video conferencing, and the 
hke. Any one of such services may, for example, communicate signals 
having data transfer rates higher than 50 Mb/s. 

In order to effectively serve a large number of customers, a 
broadband network includes switching nodes. At switching nodes, 
broadband signals are routed along selected paths so that desired signals 
are delivered from signal sources to targets (destinations). Numerous 
problems are faced by a broadband, real-time switch that accommodates a 
large number of connections. These problems result, at least in part, from 
the high data transfer rates associated with broadband communications. 
In short, a tremendous amount of data need to be processed or otherwise 
transferred through the switch during every unit of time, and the larger 
the number of connections supported by the switch, the greater the 
amoimt of data which need to be processed. 
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A practical broadband switch should be able to efficiently 
support a variety of communication services, whether or not such services 
require unidirectional or bidirectional signal traffic. For example, 
bidirectional services such as video conferencing and other interactive 
5 services that utilize point-to-point connections. Unfortunately, switching 
systems designed to efficiently handle broadcast-like communications may 
not be capable of efficiently supporting bidirectional signal traffic, and 
vice versa. Such systems may not be able to adapt to long term trends in 
upstream and downstream signal traffic demand. In addition, 

10 conventional network switches may not be able to adapt to large or rapid 
variations in the amount of upstream versus downstream traffic. 

An adaptable network switch may require less switching 
hardware than a rigidly designed switch having equivalent switching 
capabiUties. A reduction in the number of physical components is 

15 desirable to conserve space and to lower engineering, manufacturing, and 
maintenance costs. For example, given a specific mix of upstream and 
downstream switching capacities, a switching circuit that adapts to 
upstream and downstream traffic volume requires fewer components than 
an equivalent switching circuit that employs a fixed number of upstream 

20 circuits and a fixed number of downstream circuits. If the actual volume 
of upstream and downstream traffic is not proportional to the respective 
number of fixed upstream and downstream circuits, then the circuits are 
not optimally allocated and switching capacity is wasted. 

Switching capacity is also wasted when communication 

25 signals are dehvered to a network switch without being requested from a 
downstream customer. Switching circuits become busy with signal traffic 
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and the probability of blocking increases when signals are unnecessarily 
brought down to the network switch. The frequency of signal blocking can 
also increase if traffic volume is not evenly distributed among unoccupied 
or sparsely-occupied switching circuits. In addition, switching speed may 
be sacrificed if the network switch distributes signal traffic in a random or 
unstructured manner. 

As noted in US Patent 5,796,795 (Mussman et al), at 
broadband data rates, every data signal path within the switch acts like a 
transmission line having a delay proportional to its length and being 
subject to interference from signals which can cause timing or phase 
distortions. Thus, each data signal transferred through the switch has an 
optimum bit synchronization timing arrangement which defines when 
data can most rehably be extracted from the data signal's path. Moreover, 
this timing may vary from signal to signal, depending upon the physical 
connection path a given data signal follows through the switch at any 
given moment. If a clock signal is used to define bit timing for the signals, 
then the clock signal also experiences its own such distortions. Thus, 
optimal clocking in spite of timing distortions in data and clock paths is 
difficult to achieve over a large number of connections. 

Fvirthermore, physically larger switches experience worse 
timing distortions because physically larger switches have longer signal 
paths. Propagation delays vary from signal to signal and clock to clock 
through switch fabric components and/or the transmission fine signal 
paths that interconnect the components. 

One conventional solution to the timing problem is to extract 
a clock signal from each data signal path at the points in the switch where 
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the data need to be extracted. However, this solution is undesirably 
complex because it requires one or more clock recovery circuits associated 
with each data signal path, and the complexity increases as the number of 
connections increases. Consequently, this solution leads to decreased 
reliability and increased cost. Moreover, the increased complexity 
necessitated by an excessive number of clock recovery circuits requires 
physical switch power consumption and implementation space to increase, 
and these increases further exacerbate the timing problem. 

Another conventional solution to the timing problem is to 
process data in parallel rather than serially. For example, rather than 
switch single-bit serial data streams at a bit rate, a "parallel" switch can 
switch two-bit serial data streams at one-half the bit rate to achieve the 
same data throughput or more than two-bit serial streams at even lower 
bit rates to achieve the same data throughput. Unfortunately, this 
solution increases complexity by requiring proportionally more at least 
twice the number of components and interconnections, and it further 
exacerbates the timing problem by requiring proportionally more physical 
implementation space. 

A switch or a switching node as defined herein includes at 
least two major components. They are line cards, connected to other 
switching nodes or destinations to transmit and receive information 
packets, and switch cards to transfer the information packets between the 
line cards. Each switch card typically includes a crossbar switch, or series 
of parallel crossbar switches having a pluraUty of inputs and outputs that 
can connected upon command. The line cards are linked through the 
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switch card crossbars. Each switch card includes an associated arbiter to 
make the crossbar connection decisions. 

A number of problems can result if proper synchronization is 
not maintained between the line cards and switch cards. For example, 
the requests to the switch cards from the Hne cards, to access a crossbar 
connection to another Hne card, require that the timing between the line 
cards and switch cards be synchronized. Likewise, the acknowledgements 
from the switch cards to the hne cards require synchronized 
communications. The transfer of information by frames, and the tracking 
of the frames being transferred requires a common timing base between 
line and switch cards. Further, a line card may service the various 
crossbars of a switch card in a round robin type fashion, which once again 
requires synchronization. In appHcations that reserve bandwidth, with 
preprogrammed connections that bypass the bid 

request/acknowledgement handshaking, synchronized timing becomes 
even more critical. 

It would be advantageous if Une cards could be synchronized 
to switch cards without adding additional overhead to the information 
link between the cards. Further it would be advantageous if the 
synchronization could be performed on an auxiliary communication link 
between the line cards and the switch cards. 

It would be advantageous if line cards could be replaced and 
resynchronized without reinitializing the switch host. 

It would be advantageous if switch cards could be replaced 
and resynchronized without reinitializing the switch host. 
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SUMMARY OF THE INVENTION 

Accordingly, a method is provided for synchronizing timing 
in the transfer of information across a switch. The method comprises: 
designating a master switch card, having a master switch timing 
reference, from a plurahty of switch cards; from the plurahty of line cards, 
designating a master line card and slave line cards; synchronizing a 
plurality of line cards for transceiving information packets in response to 
communications with the master switch card; and, synchronizing a 
plurality of switch cards, controlling the distribution of the information 
packets, in response to communications with the master line card. 

The plurality of switch cards are synchronized in response to 
communications conducted exclusively with the line cards. Likewise, the 
line cards are synchronized in response to communications conducted 
exclusively with the switch cards. 

More specifically, synchronizing line cards in response to 
communications with the master switch card includes the sub-steps of: 
receiving timing signals at the master switch card from each of the line 
cards; and, sending timing corrections from the master switch card to each 
of the line cards. Synchronizing the slave switch cards to the master 
switch timing reference in response to communications with the master 
line card includes the sub-steps of: each slave switch card receiving a 
timing signal, with a local timing reference synchronized to the master 
switch timing reference, from the master line card; and, each slave switch 
card synchronizing its respective slave switch timing reference to the 
received local timing reference. 
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Additional details of the above-described timing 
synchronization method and a system for synchronizing line cards and 
switch cards in a broadband switch are provided below. 

BRIEF DESCRIPTION OF THE DRAWING 

Fig, 1 is a schematic block diagram of a system for 
synchronizing switch timing. 

Fig. 2 is a timing diagram illustrating the relationship 
between the master switch timing reference and the local timing 
references. 

Fig. 3 is a schematic block diagram illustrating specifics of 
the line card and switch card timing elements. 

Fig, 4 is a schematic block diagram illustrating the specifics 
of the slave switch card synchronization process. 

Figs. 5a and 5b are a flowchart depicting a method for 
synchronizing timing in a broadband switch. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

Fig. 1 is a schematic block diagram of a system for 
synchronizing switch timing. The switch system 100 comprises a 
plurality of line cards 102a, 102b, through 102n. Although three line 
cards are depicted, the invention is not limited to any particular number 
of line cards. Each line card 102a- 102^ has an information port 104a, 
104b through 104^1, respectively, to transmit and receive information 
packets. For simplicity, the left side (information port) of each of the line 
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cards 102a-102/i is shown as having a single Une to receive information 
and a single line to transmit information packets. However, the invention 
is not limited to any particular number of input or output lines. Further, 
there need not be any correlation between the number of input lines and 
5 the number of output lines. 

Generally, the switch accepts information packets from a 
plurality of sources addressed to a plurality of destinations. The switch 
100 acts to route communications from a source to a destination. 
Typically, there is contention between a number of information packets 
10 addressed to a common destination. Switching decisions are made at the 
level of individual information packets, or upon cells within information 
packets. 

Each line card 102a- 102n has a control port 106a, 106b, 
through 106/1, respectively, to accept commands for controlUng the 

15 distribution of the information packets. Each line card 102a-102r^ 

maintains synchronization in response to timing signals communicated 
through their respective control port 106a"106n. 

The switch system 100 further comprises a plurality of 
switch cards 108a through 108/i. As depicted, the number of switch cards 

20 equals the number of line cards. However, the invention is not limited to 
any particular number of switch cards, and the number of switch cards 
need not necessarily match the number line cards. Each switch card 
108a-108/i has a control port 110a through llOn, respectively, connected 
to the plurality of line cards 102a- 102n to send information packet control 

25 commands. Each switch card 108a- 108n, maintains synchronization in 
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response to timing signal communications with the line cards through 
their respective control ports 110a-110?i. 

The plurality of switch cards lOSa-lOS/i include a master 
switch card, having a master switch timing reference, and slave switch 
5 cards. For the purpose of demonstration, switch card 108a is selected as 
the master switch card, and switch cards 108b and 108n as the slave 
switch cards. The selection of the master switch card 108a can be the 
result of external control (not shown), random selection, priority ranking 
among switch cards, or even a round-robin priority method. The selection 

10 process is not critical to the invention. Regardless of the selection criteria, 
the line cards 102a-1027^ maintain synchronization in response to timing 
signal communications with the master switch card (hereafter it is 
assumed that the master switch card is switch card 108a). 

Likewise, the plurality of line cards 102a-102n include a 

15 master line card and slave line cards. Again, a number of selection 
processes are possible, and for the following explanation it is assumed 
that line card 102a is the master line card. The slave switch cards 108b 
and 108n. maintain synchronization in response to timing signal 
communications with the master line card 102a. 

20 In one aspect of the invention, as depicted, the switch card 

control ports llOa-llOn are connected exclusively to line card control 
ports 106a-106?i. Alternately stated, there are no timing synchronization 
connections between switch cards 108a- lOSn,. Further, there are no 
connections or direct communications between line cards 102a- 102^1. The 

25 master switch card 108a receives timing signals from each of the line 
cards 102a-102Ai, and sends timing corrections to the line cards. 
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More specifically, the master switch card 108a receives a 
timing signal including a local timing reference from each of the line cards 
102a-102/i. The master switch card 108a compares the local timing 
reference from a particular line card to the master switch timing 
5 reference, creates a timing offset between the local timing reference and 
the master switch timing reference, and supplies the timing offset in a 
timing signal to the line card. Then, that particular hne card modifies its 
local timing reference in response to receiving the timing signal with the 
timing offset from the master switch card 108a. 

10 Fig. 2 is a timing diagram illustrating the relationship 

between the master switch timing reference and the local timing 
references. As shown in reference to a clock signal, the master switch 
timing reference generates a timing reference in cycle 1 of a periodic cycle 
of clock pulses. For simplicity, a period of eight clock cycles in shown. 

15 However, the number of cycles in a period is typically related to the 

product of the number of crossbars in a switch card, the number of cells in 
an information packet frame, and the number of cycles in a bid accept 
frame. The timing reference signal is represented by the comma symbol 
The master switch receives a local timing reference in cycle 2 from 

20 line card 102a (LCa). The master switch also receives a local timing 
reference signal in cycles 3 and 4 from line cards (LCn) 102n and (LCb) 
102b, respectively. The master switch sends a signal to line card 102a 
with a timing offset of 2. A timing offset of 4 and 3 are sent to Une cards 
102b and 102n, respectively. The individual line cards add their 

25 respective timing offsets to their counts to become synchronized with the 
master switch timing reference. For example, at clock cycle 0, line cards 
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102a adds to 2 to its current count of 6 (6 clock periods since its own local 
timing reference ",") to yield a 8, or 0 in the periodic base 8 clock. At clock 
cycle 0, the master switch timing reference also has a count of 0 so the 
local timing reference of line card 102a becomes synchronized to the 
5 master switch timing reference. Line cards 102b and 102m are 
synchronized in the same manner. 

Each slave switch card 108b and 108n. receives a timing 
signal, with a local timing reference synchronized to master switch timing 
reference, from the master line card 102a. Each slave switch card 108b 

10 and 108n adopts the local timing reference of the master hne card 102a as 
the slave switch timing reference. 

Fig. 3 is a schematic block diagram illustrating specifics of 
the switch card and line card timing elements. Each switch card includes 
a counter to generate a timing reference that is the overflow count of a 

15 first predetermined number at a first predetermined rate. As shown, the 
master switch counter 300 is a four-bit binary counter operating the same 
rate as the clock of Fig. 2. The counter increments a count every clock 
cycle, and when the count exceeds 8 (1111), an overflow occurs and the 
counter is reset to zero (0000), Likewise, each line card includes a counter 

20 to generate a timing reference that is the overflow count of a first 
predetermined number at a first predetermined rate. 

The master switch card 108a uses its overflow count as the 
master switch timing reference. Thus, the generated by the master 
switch timing reference in Fig. 2 is the result of the master switch card 

25 counter overflowing in clock cycle 0. It should be noted that there is no 
particular relationship between the counter phase (the overflow count) 
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and any particular clock cycle. That is, the master timing reference need 
not occur at clock cycle 0. The master switch 108a compares its count to 
each line card when it overflows, generating the symbol, notes the 
difference between the master switch count and each line card overflow 
5 count, and supplies each line card its respective measured difference as 
the timing offset. 

As shown, a comparator 302 has an input on line 306 to 
accept the master switch card count and an input on line 308 to accept the 
overflow count from line card 102a. The counts are compared to yield the 

10 timing offset on line 310. In some aspects of the invention, the 

comparator is a adder circuit that adds the counts of the master switch 
counter 300 to the line card overflow count (of 0) and yields a sum on line 
310 that is the current count of the master switch counter 300. 

As explained above, each line card can be considered to have 

15 an adding function that adds its respective measured difference (timing 
offset) to its counter, to yield a synchronized count. Referring again to 
Fig. 3, line card 102a has a counter 312 to supply an overflow count on 
line 308. Line card 102a accepts the timing offset on line 310, and the 
timing offset is added to the counter 312, so the counts of counters 300 

20 and 312 agree. An equivalent operation is carried out for the other line 
cards 102b and 102n. 

Fig. 4 is a schematic block diagram illustrating the specifics 
of the slave switch card synchronization process. The master line card 
counter 312 generates an overflow that is now synchronized to the 

25 overflow count of the master switch counter 300 (see Fig. 3). This 

overflow count is received by all the slave switch cards, slave switch card 
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108b is shown as an example. The counters or equivalent timing circuits 
of the slave switch card are synchronized to the overflow count on line 
402. Alternately, master line card counter 312 has an output to provide 
its current count on line 402 and the slave switch counter 400 just adopts 
5 the current count provided by counter 312. 

Some of the advantages of the invention are the ease of 
initialization and replacement of either line or switch cards. For example, 
when the line cards and switch cards are initiaUzed at start up, the 
master switch card counter 300 is initialized. The initial value chosen for 
10 the count can be arbitrary. Then, the line cards are synchronized with 
timing signal communications responsive to the initiahzed master switch 
card counter. 

If the master switch card is turned off after synchronizing 
the line cards, or the master switch card becomes non-functional, an 

15 alternate switch card can be selected as the master switch card from the 
plurality of slave switch cards, and the selected master switch card 
maintains the master switch timing reference. A variety of processes may 
be used to select the new (alternate) master switch card. The plurality of 
line cards maintain synchronization in response to timing signal 

20 communications with the alternate master switch card. 

Likewise, if the master line card is turned off after 
synchronizing the slave switch cards, or if the master line card becomes 
non-functional, an alternate line card is selected as the master line card 
from the plurality of slave line cards, and maintains synchronization with 

25 the master switch card. Again, the specific selection process is not critical. 
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The slave switch cards maintain synchronization in response to timing 
signal communications with the alternate master line card. 

Figs. 5a and 5b are a flowchart depicting a method for 
synchronizing timing in a broadband switch. Although the method is 

5 depicted as a series of numbered steps for clarity, no order should be 

inferred from the numbering unless explicitly stated. The method begins 
with Step 500. Step 502 synchronizes a plurality of line cards for 
transceiving information packets. Step 504 synchronizes a plurality of 
switch cards controlling the distribution of the information packets, in 

10 response to communications with the line cards. 

Step 501, from the plurality of switch cards, designates a 
master switch card, having a master switch timing reference, and slave 
switch cards. Synchronizing a plurality of line cards in Step 502 includes 
synchronizing line cards to the master switch timing reference in response 

15 to communications with the master switch card. 

Step 503a designates a master line card and slave line cards 
from the plurality of line cards. Synchronizing a plurality of switch cards 
in response to communications with the line cards in Step 504 includes 
synchronizing the slave switch cards to the master switch timing 

20 reference in response to communications with the master hne card. 

In some aspects of the invention, synchronizing a plurality of 
switch cards in response to communications with the line cards in Step 
504 includes establishing exclusive communications between the switch 
cards and the line cards. That is, timing synchronization communications 

25 are prohibited between the switch cards. In some aspects of the invention, 
synchronizing line cards to the master switch timing reference in response 
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to communications with the master switch card in Step 502 includes 
prohibiting communications between the hne cards. Alternately stated, 
Step 502 includes establishing exclusive communications between the 
switch cards and the line cards. 
5 Synchronizing line cards in response to communications with 

the master switch card includes sub-steps. Step 502a receives timing 
signals at the master switch card from each of the line cards. Step 502b 
sends timing corrections from the master switch card to each of the line 
cards. 

10 In some aspects of the invention, receiving timing signals at 

the master switch card from each of the line cards in Step 502a includes 
the master switch card receiving a timing signal including a local timing 
reference from each of the line cards. 

Sending timing corrections from the master switch card to 

15 the line cards includes sub-steps. Step 502bl compares the local timing 
reference from each line card to the master switch timing reference. Step 
502b2 creates a timing offset between each local timing reference and the 
master switch timing reference. In Step 502b3 the master switch card 
supplies each timing offset to its respective line card. In Step 502b4 each 

20 line card modifies its local timing reference in response to receiving its 
respective timing offset. 

Synchronizing the slave switch cards to the master switch 
timing reference in response to communications with the master line card 
includes sub-steps. In Step 504a each slave switch card receives a timing 

25 signal, with a local timing reference synchronized to the master switch 
timing reference from the master line card. In Step 504b each slave 
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switch card synchronizes its respective slave switch timing reference to 
the received local timing reference. 

In Steps 502 and 504 each switch and line section generates 
a timing reference that is the overflow count in the cyclical generation of a 

5 first predetermined number at a first predetermined rate. Designating a 
master switch card having a master switch timing reference in Step 503a 
includes using the master switch card overflow count as the master switch 
timing reference. Comparing local timing references, from a plurality of 
line cards, to the master switch timing reference in Step 502b 1 includes 

10 comparing the master switch count to each of the line card overflow 

counts. Creating a timing offset between each local timing reference and 
the master switch timing reference in Step 502b2 includes measuring the 
difference between each line card overflow count and the master switch 
card count. Supplying timing offsets to each of the line cards in Step 

15 502b3 includes supplying each line card with the differences between its 
respective overflow count and the master switch card count. Each of the 
plurality of line cards modifying its local timing reference in response to 
receiving its respective timing offset in Step 502b4 includes each line card 
adding the its respective overflow count difference to its count. 

20 Each slave switch card receiving a timing signal, with a local 

timing reference synchronized to the master switch timing reference, in 
Step 504a includes each slave switch card receiving a signal with an 
overflow count synchronized to the master switch count. Each slave 
switch card synchronizing its respective slave switch timing reference to 

25 the received local timing reference in Step 504b includes each slave switch 
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card synchronizing its respective count to the master line card overflow 
count. 

Step 501a initializes the line and switch cards. Step 503b 
initializes the master switch card master switch timing reference. 
5 Synchronizing the slave switch cards in Step 504 includes synchronizing 
the line cards to the initialized master switch card master timing 
reference. 

Upon failure of the master switch card, Step 506 turns off the 
master switch card following the synchronization the pluraUty of switch 

10 cards. Step 508 selects an alternate switch card as the master switch card 
from the plurality of slave switch cards. Step 510 maintains the master 
switch timing reference with the alternate master switch card. 
Synchronizing the plurality of line cards in Step 502 includes maintaining 
the synchronization of the line cards using the alternate master switch 

15 card master switch timing reference. 

Upon a failure of the master line card, Step 512 turns off the 
master line card following the synchronizing of the plurality of switch 
cards. Step 514 selects an alternate line card as the master line card from 
the plurality of slave line cards. Step 516 maintains the synchronization 

20 of the alternate master line card timing reference to the master switch 
card clock. Synchronizing the pluraUty of switch cards in Step 504 
includes maintaining the synchronization of the slave switch cards to the 
alternate master hne card. 

The invention has been described above in the context of an 

25 eight cycle clock and a binary eight counter. However, the specific of the 
counting process where given merely as an illustration. Likewise, the 

Gray CaryXSDM 401 842.1 
103747-165124 



DOCKET NO. AMCC4620 

48- 



format of the signals used to communicate the local timing reference need 
not be the same as presented above. More critical to the invention is the 
fact that the Une counters send timing information to the master line 
card, and the master switch card sends information to the line switch 
cards to correct their timing to match the master switch card. In another 
embodiment of the invention a master line card is not used. The slave 
switch cards are able to synchronize timing in response to 
communications with any Hne card. Other variations and embodiments to 
accomplish this fundamental task will occur to those skilled in the arts. 



WE CLAIM: 
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